Estimation  from  Relative  Measurements: 
Electrical  Analogy  And  Large  Graphs 

Prabir  Barooah,  Student  Member,  IEEE,  Joao  P.  Hespanha,  Member,  IEEE 


1 


CCDC  Technical  Report,  Sept.  12,  2007 


Abstract — We  examine  the  problem  of  estimating  vector¬ 
valued  variables  from  noisy  measurements  of  the  difference 
between  certain  pairs  of  them.  This  problem,  which  is  naturally 
posed  in  terms  of  a  measurement  graph,  arises  in  applications 
such  as  sensor  network  localization,  time  synchronization,  and 
motion  consensus. 

We  obtain  a  characterization  on  the  minimum  possible  covari¬ 
ance  of  the  estimation  error  when  an  arbitrarily  large  number 
of  measurements  are  available.  This  covariance  is  shown  to 
be  equal  to  a  matrix-valued  effective  resistance  in  an  infinite 
electrical  network.  Covariance  in  large  finite  graphs  converges 
to  this  effective  resistance  as  the  size  of  the  graphs  increases. 
This  convergence  result  provides  the  formal  justification  for 
regarding  large  finite  graphs  as  infinite  graphs,  which  can  be 
exploited  to  determine  scaling  laws  for  the  estimation  error  in 
large  finite  graphs.  Furthermore,  these  results  indicate  that  in 
large  networks,  estimation  algorithms  that  use  small  subsets  of 
all  the  available  measurements  can  still  obtain  accurate  estimates. 

I.  INTRODUCTION 

We  consider  the  estimation  of  vector-valued  variables  based 
on  noisy  measurements  of  the  difference  between  certain  pairs 
of  such  variables.  In  particular,  denoting  the  variables  of 
interest  by  {xu  :  u  £  V}  where  V  :=  {1,  2, . . .  },  we  consider 
problems  for  which  noisy  “relative  measurements”  of  the  form 

Cu,v  —  'Tu  tcv  T  eU:V  (1) 

are  available,  where  eu_v  denotes  measurement  noise.  The 
ordered  pairs  of  indices  (u,  v )  for  which  we  have  relative 
measurements  form  a  set  E  that  is  a  (typically  strict)  subset 
of  the  set  *F  x  *F  of  all  pairs  of  indices.  Just  with  relative 
measurements,  the  xu’s  can  be  determined  only  up  to  an 
additive  constant.  To  avoid  this  ambiguity,  we  assume  that 
a  particular  variable  (say  x0)  is  used  as  the  reference  with 
x0  known.  The  problem  of  interest  is  to  estimate  the  node 
variables  from  all  the  available  measurements.  This  estimation 
problem  is  relevant  to  several  sensor  and  multi-agent  network 
applications,  such  as  localization  with  noisy  distance  and  angle 
measurement  [1-3],  time-synchronization  [2, 4,  5]  and  motion- 
coordination  [6];  see  [6,  7]  for  an  overview.  The  estimation 
problem  we  study  is  an  instance  of  a  general  class  of  pa¬ 
rameter  estimation  problems  in  sensor  networks  called  self¬ 
calibration  [3,  8],  Among  the  applications  mentioned  above. 
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localization  in  sensor  networks  has  probably  attracted  the  most 
attention  in  recent  times.  The  reader  is  advised,  however, 
that  localization  from  range-only  measurements,  such  as  those 
considered  in  [9,  10],  do  not  fall  into  the  problem  category 
investigated  in  this  paper. 

The  measurement  equations  (1)  can  be  expressed  in  terms 
of  a  directed  graph  Q  =  ('F,  “£)  with  an  edge  from  node  u  to 
v  if  the  measurement  (UtV  is  available.  The  graph  Q  is  called 
the  measurement  graph ,  and  each  vector  xu,  it  G  'F  is  called 
the  u-th  node  variable. 

The  main  result  of  this  paper  relates  to  infinite  sets  of 
available  measurements,  which  is  used  to  model  the  limiting 
case  for  a  very  large  number  of  measurements.  When  the 
number  of  measurements  is  infinite,  we  show  that  for  every 
positive  constant  e  >  0,  it  is  possible  to  construct  an  unbiased 
estimate  for  a  node  variable  xu  that  uses  only  a  finite  subset 
of  the  available  measurements  but  whose  estimation  error 
variance  is  only  e  above  the  minimum  possible  estimation 
error  variance  that  could  be  obtained  by  considering  the  whole 
infinite  set  of  measurements.  The  main  assumption  needed  is 
that  the  graph  must  have  a  finite  maximum  node  degree,  i.e., 
that  there  is  a  maximum  number  of  relative  measurements 
involving  each  node  variable.  An  implication  of  this  result  is 
that  for  estimation  problems  based  on  relative  measurements, 
after  a  certain  point,  considering  more  measurements  will  only 
marginally  improve  the  quality  of  the  estimate.  On  the  positive 
side,  this  simplifies  the  construction  of  estimation  algorithms 
in  large-scale  networks  because  it  justifies  considering  a  rela¬ 
tively  small  subset  of  measurements.  Distributed  algorithms 
to  estimate  the  node  variables  from  relative  measurements 
have  been  examined  in  [2,  7]  in  which  nodes  with  embed¬ 
ded  processing  and  communication  capability  estimates  their 
variables  by  local  computation  and  communication.  Although 
the  algorithms  in  [2,  7]  were  developed  for  finite  graphs,  in  a 
large  graph  these  algorithms  may  take  a  long  time  to  provide 
accurate  estimates,  since  the  information  about  all  the  available 
measurements  are  fused  iteratively  to  determine  the  estimates. 
The  results  of  this  paper  suggest  that  it  may  be  possible  to 
devise  algorithms  such  that  they  obtain  estimates  quite  fast, 
while  sacrificing  little  accuracy. 

Another  contribution  of  this  paper  is  that  the  results  es¬ 
tablished  here  help  determine  how  the  estimation  error  grows 
as  the  network  size  increases.  It  is  often  easier  to  establish 
asymptotic  results  on  the  minimum  error  variance  for  infinite 
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graphs  than  for  large  finite  graphs,  since  boundary  effects  are 
usually  weaker  in  infinite  graphs  than  in  finite  graphs.  Scaling 
laws  for  the  minimum  estimation  error  in  infinite  graphs  are 
investigated  in  [11].  The  main  convergence  result  of  this  paper 
provides  the  formal  justification  for  regarding  infinite  graphs 
as  suitable  proxies  for  very  large  but  finite  graphs.  It  was 
assumed  in  [11]  that  estimation  error  covariances  in  infinite 
graphs  are  well-defined.  We  show  in  this  paper  that  this 
assumption  is  indeed  valid,  if  certain  properties  are  satisfied 
(those  stated  in  Theorem  1).  Therefore,  the  results  in  this  paper 
also  establish  the  conditions  under  which  approximation  of 
large  finite  graphs  by  infinite  graphs  is  valid. 

The  key  technical  tool  used  to  prove  the  results  discussed 
above  is  the  analogy  between  the  measurement  network  and 
an  electrical  network.  When  the  node  variables  are  scalars  and 
the  measurement  graph  is  finite,  the  variance  of  the  estimation 
error  for  a  node  variable  xu  is  numerically  equal  to  the 
effective  resistance  between  the  node  u  and  the  reference  node 
o  of  an  electrical  network  obtained  from  the  measurement 
graph  by  placing  at  each  edge  (u,  v)  £  E  a  resistor  whose 
resistance  is  equal  to  the  variance  of  the  measurement  error 
eUtV.  This  electrical  analogy  was  noted  by  Karp  et  al.  [4]  for 
the  time-synchronization  problem. 

In  this  paper,  we  show  that  an  electrical  analogy  still  holds 
for  vector-valued  node  variables,  provided  that  we  consider 
generalized  electrical  networks  in  which  currents,  voltages, 
and  resistors  are  matrix-valued,  but  still  satisfy  appropriately 
adapted  forms  of  Kirchoff’s  and  Ohm’s  laws.  In  this  case, 
the  electrical  network  is  obtained  by  placing  at  each  edge 
( u,v )  €  E  a  resistor  whose  (matrix-valued)  resistance  is 
equal  to  the  covariance  matrix  of  the  measurement  noise 
eu,v ■  We  further  show  that,  when  the  measurement  graph  is 
infinite,  as  one  considers  increasingly  large  but  finite  subsets 
of  the  measurements,  the  covariance  matrix  of  the  estimation 
error  of  a  node  variable  xu  converges  to  the  (matrix-valued) 
effective  resistance  between  node  u  and  the  reference  node  o 
of  an  infinite  generalized  electrical  network  obtained  from  the 
infinite  measurement  graph. 

For  certain  infinite  measurement  graphs,  such  as  d- 
dimensional  square  lattices,  the  effective  resistances  can  be 
explicitly  computed.  Because  of  the  electrical  analogy  and  the 
convergence  result  established  in  this  paper,  one  can  determine 
the  smallest  estimation  error  variance  that  could  be  obtained  by 
considering  the  whole  (infinite)  set  of  measurements  in  such 
graphs.  In  practice,  measurement  graphs  may  not  be  lattices, 
but  it  is  generally  possible  to  embed  them  in  lattices  or  find 
lattices  that  can  be  embedded  in  measurement  graphs  [11,  12], 
It  turns  out  that  estimation  error  variances  are  monotonic  with 
respect  to  the  partial  order  defined  by  graph  embedding,  which 
is  a  consequence  of  our  extension  of  the  so-called  Rayleigh’s 
Monotonicity  Law  [12]  to  generalized  electrical  networks.  As 
a  consequence,  we  can  construct  upper  and  lower  bounds  on 
the  estimation  error  variances  in  these  measurement  graphs 
from  the  results  available  for  lattices.  A  preliminary  study 
on  establishing  scaling  laws  for  the  estimation  error  variance 
in  large  graphs  using  embedding  in  lattices  was  undertaken 
in  [11]. 


Numerical  studies  on  subgraphs  of  the  2-dimensional  lattice 
show  that  information  from  a  relatively  small  finite  subgraph 
of  the  infinite  measurement  graph  is  sufficient  to  provide 
an  estimate  whose  variance  is  quite  close  to  the  minimum 
variance  that  is  achievable  by  using  all  the  measurements. 
Increasing  the  size  of  the  subgraph,  i.e.,  increasing  the  number 
of  measurements  processed  beyond  a  certain  point  does  not 
yield  a  commensurate  return  in  the  decrease  in  variance.  In 
particular,  when  constructing  the  BLU  estimate  of  a  partic¬ 
ular  node  u’ s  variable,  if  all  measurements  involving  nodes 
lying  within  a  distance  of  twice  the  distance  between  u  and 
the  reference  are  used,  the  difference  between  the  resulting 
estimation  error  variance  of  xu  and  the  minimum  possible 
variance  is  less  than  10%.  For  an  arbitrary  infinite  graph, 
similar  trends  are  expected  as  long  as  the  graph  is  close  to 
a  lattice  in  an  appropriate  sense.  The  question  of  what  is  a 
meaningful  measure  for  a  graph  to  be  close  to  a  lattice  for  the 
BLU  estimation  problem  has  been  addressed  in  [11], 

The  rest  of  the  paper  is  organized  as  follows.  Section  II 
summarizes  the  main  result  of  the  paper.  Section  III  introduces 
generalized  electrical  networks.  Section  IV  establishes  the 
analogy  between  the  estimation  and  electrical  network  prob¬ 
lems  for  finite  measurement  graphs  and  uses  this  to  prove  the 
main  result.  Section  V  describes  scaling  laws  for  the  minimum 
possible  estimation  error  in  lattices  and  a  numerical  study  on 
the  convergence  of  the  estimation  error  covariances  in  finite 
subgraphs  as  the  subgraphs  are  increased  in  size.  The  paper 
concludes  with  a  summary  in  Section  VI. 

II.  Main  Result 

Consider  a  set  of  vector- valued  variables  xu  £  Rfc,  u  £ 
V  :=  {1,  2, . . .  },  where  the  set  If  is  either  finite,  or  infinite 
but  countable.  These  variables  are  to  be  estimated  based  on 
noisy  relative  measurements  of  the  form: 

Cu,v  —  tcu  xv  T  Cu,v>  (ti,  it)  £  21  (2) 

where  e,M,  denotes  a  zero-mean  measurement  noise  and  21 
is  the  set  of  pairs  (u,  v)  for  which  relative  measurements  are 
available.  The  covariance  matrix  of  the  error  e,M,  is  denoted 
by  Pu,v  '■=  E [cu,v^u,v]’  where  E(-)  denotes  expectation  and 
(•)T  denotes  transpose.  The  measurement  error  covariance 
matrices  are  assumed  to  be  positive  definite  and  finite.  The 
measurement  errors  on  different  edges  are  uncorrelated,  i.e., 
for  two  edges  e,  e  £  21,  E[eee;T]  =  0  unless  e  =  e.  We  assume 
that  the  value  of  a  particular  reference  variable  x0  is  known 
and  without  loss  of  generality  we  take  xa  =  0. 

The  accuracy  of  a  node  variable’s  estimate,  measured  in 
terms  of  the  covariance  of  the  estimation  error,  depends  on 
the  graph  Q  as  well  as  the  measurement  error  covariances. 
The  estimation  problem  is  therefore  formulated  in  terms  of 
a  network  {G,P)  where  P  :  21  — >  §fe+  is  a  function  that 
assigns  to  each  edge  (u,  v)  £  21  the  error  covariance  matrix 
Puv  of  the  measurement  error  associated  with  the  edge  (u,  v). 
The  symbol  Sk+  denotes  the  set  of  k  x  k  symmetric  positive 
definite  matrices. 

We  are  interested  in  problems  for  which  the  set  of  variables 
and  available  measurements  is  very  large.  We  model  this 
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situation  by  making  the  number  of  variables  and  measurements 
countably  infinite.  The  measurement  graph  Q  is  therefore 
an  infinite  graph.  In  such  problems,  the  question  arises  if 
it  is  possible  to  construct  an  estimate  of  an  arbitrary  node 
variable  xu  by  using  only  a  finite  subset  of  measurements  such 
that  its  error  covariance  is  arbitrarily  close  to  the  minimum 
error  covariance  achievable  by  using  all  the  infinite  number 
of  measurements.  To  pose  this  question,  we  focus  on  an 
arbitrary  node  u  €  ‘V  —  hereafter  called  the  node  of  interest 
—  and  examine  the  estimates  of  xu  using  larger  and  larger 
“subgraphs”  as  described  next.  First  we  recall  certain  graph 
theoretic  terminology.  A  undirected  path  between  a  pair  of 
nodes  U\  and  it  ,v  in  a  graph  is  a  finite,  alternating  sequence  of 
nodes  and  edges  u\,  e±,U2,  e2, . . . ,  ejv-i,  un  such  that  every 
edge  is  incident  on  its  two  adjacent  nodes  in  the  sequence, 
and  no  node  or  edge  is  repeated.  An  edge  ( u ,  v)  is  said  to  be 
incident  on  the  nodes  u  and  v.  A  directed  graph  is  said  to  be 
weakly  connected  if  there  is  an  undirected  path  between  every 
pair  of  nodes.  For  two  graphs  Gi  =  (flf ,  £1),  G2  =  (£2,  £2), 
the  notation  Gi  C  G2  means  £1  C  £2  and  £1  C  £2-  We 
now  consider  a  sequence  of  finite  measurement  subgraphs 
G^\  Q1'2'1 ,  G^, . . .  that  satisfies  the  following  assumption. 

Assumption  1  ( Nested  sequence):  The  sequence  of  finite 
graphs  f/W ,  C* ,  C* ,. . . .  has  the  following  properties: 

1)  The  sequence  is  nested  in  the  sense  that 

g(l)  c  g(  2)  c  g(  3)  C...Cgf 

2)  The  sequence  converges  to  the  graph  Q  in  the  sense  that 
every  node  and  edge  in  G  appears  in  one  of  the  Q { " 1  for 
some  finite  n. 

3)  Each  finite  graph  G^n\  n  €  N  is  weakly  connected. 

□ 

In  constructing  such  a  nested  sequence  of  finite  graphs, 
every  graph  Q ! " 1  should  contain  the  reference  node  o  and 
the  node  of  interest  u.  Figure  1  shows  the  first  few  elements 
of  such  a  nested  graph  sequence  that  will  eventually  converge 
to  the  2-dimensional  square  lattice  (the  formal  definition  of  a 
lattice  will  be  provided  in  Section  V-A).  One  could  regard  each 
finite  subgraph  Q1'  71'1  as  describing  a  finite  subset  of  available 
measurements  that  could  be  processed  up  to  some  time  tn  < 
00  to  construct  an  estimate  of  xu.  As  time  increases,  more 
measurements  can  be  processed,  and  therefore  at  some  time 
tn+ 1  >  tn,  the  subgraph  contains  more  measurements 

than  (/ ■n) .  In  this  context,  we  are  interested  in  studying  if 
there  is  a  point  after  which  there  is  little  gain  in  processing 
more  measurements,  as  this  will  not  improve  the  estimate  of 
xu  significantly.  Essentially,  we  are  asking  whether  or  not  the 
sequence  of  estimates  produced  using  the  nested  sequence  of 
subgraphs  converges. 

Given  a  finite  subset  of  measurements  characterized  by 
one  of  the  graphs  G(n\  it  is  straightforward  to  compute  the 
Best  Linear  Unbiased  (BLU)  estimate  .cj"'  that  minimizes  the 
estimation  error  variance  among  all  linear  unbiased  estimators. 
This  estimate  is  a  linear  combination  of  the  measurements 
(e,  e  €  £  specified  by  a  set  of  appropriately  chosen  coefficient 


matrices.  In  particular,  the  BLU  estimate  is  given  by 

4n)=  E  °in)T^  (3) 

ee£<n) 

where  the  function  C ^  ^  — >  Rkxk  specifies  the 

coefficients  of  the  measurements.  Note  that  in  the  equation 
above,  and  in  the  sequel,  for  a  function  /  with  the  edge  set  £ 
as  the  domain,  we  use  fe  to  denote  the  value  of  the  function  at 
an  edge  eg£.  We  call  the  function  C(n>  the  BLU  estimator 
for  xu  based  on  the  finite  graph  G^n- 

Every  estimator  Cln'1  can  be  viewed  as  an  element  of  the 
real  linear  vector  space  Ti p  consisting  of  all  edge-functions  of 
the  form  C  :  £  lht  for  which 

lie'll2  :=ETr(C'eT^C'e)  <00,  (4) 

e£!E 

where  Tr(-)  denotes  trace,  and  each  Pe  denotes  the  error 
covariance  matrix  for  the  measurement  associated  with  the 
edge  e  G  £.  It  is  straightforward  to  show  that  Tip  is  a 
Hilbert  space  with  the  associated  inner  product  (C,  C)  = 
^e6!E  Tr(C^PeCe),  VC,  C  €  Tip.  We  say  that  an  edge- 
function  in  Tt p  has  finite  support  if  it  has  only  a  finite  number 
of  nonzero  entries.  Since  all  the  sets  (E  n'>  in  (3)  are  finite, 
every  estimator  Cf"  '!  is  a  finite-support  edge-function  in  Lip. 

For  infinite  graphs,  the  summation  in  (4)  is  actually  a  series. 
However,  the  series  is  absolutely  convergent  due  to  the  positive 
definiteness  of  the  Pf  s,  hence  the  order  of  the  summation  is 
immaterial  and  therefore  the  expression  in  (4)  is  well  defined. 

We  now  state  the  main  result  of  the  paper,  which  establishes 
the  convergence  of  BLU  estimators  as  n  — >  00.  To  state  this 
result  we  recall  that  the  degree  of  a  node  is  defined  as  the 
number  of  edges  that  are  incident  on  the  node. 

Theorem  1  (BLU  Convergence):  Consider  a  network 
(G,  P)  for  which  the  measurement  graph  G  has  a  finite 
maximum  node  degree,  and  for  which  the  error  covariance 
function  P  is  uniformly  bounded  in  the  sense  that  there  exist 
constant  matrices  Pmin,  Pmax  £  §fe+  such  that 

P  <  P  <  P  Vpg£ 

where  A  <  B  means  that  A  -  Bis  negative  semi-definite. 
For  every  node  u  £  If  \  {o},  where  o  is  the  reference  node, 
if  {G{n)}  is  a  nested  sequence  of  finite  graphs  that  satisfies 
Assumption  1  with  u  and  o  belonging  to  every  graph  in  the 
sequence,  the  following  statements  hold. 

1)  The  sequence  of  BLU  estimates  {x[f^}  converges  in  the 
mean-square  sense. 

2)  The  sequence  of  BLU  estimators  {C^}  for  xu  con¬ 
verges  to  some  C  Cl  Lip. 

3)  The  sequence  of  BLU  estimation  error  co-variance  ma¬ 
trices 

Z%l:=E[(xu-xW)(xu-xW)T] 

converges  to  a  symmetric  positive  definite  matrix  EUj0. 
Moreover,  these  BLU  covariances  converge  monotoni- 
cally  in  the  sense  that 

£$  >  >  •  >  EUl0  >0.  □ 
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(a) 


(b)  g(2) 


(c) 


Fig.  1.  A  nested  sequence  of  measurement  graphs  that  “tend  to”  the  2-dimensional  square  lattice. 


Theorem  1  shows  that  under  the  bounded  degree  assump¬ 
tion,  by  using  only  a  finite  number  of  measurements  among 
the  infinitely  many  potentially  available,  we  can  construct 
estimates  whose  error  variance  is  arbitrarily  close  to  the 
minimum  possible  variance  that  could  be  achieved  by  using 
all  the  available  measurements.  In  addition,  the  estimates 
themselves  converge  and  the  “limiting”  estimator  is  square- 
summable  in  the  sense  of  (4). 

Although  Theorem  1  states  that  the  BLU  covariances  in 
the  finite  graphs  converges  to  a  limiting  covariance  £Ui0,  it 
does  not  specify  what  the  limit  is.  However,  the  proof  of 
this  result  actually  provides  a  construction  to  obtain  £U)0 
from  the  network  ( Q ,  P )  by  showing  that  it  is  numerically 
equal  to  a  matrix-valued  generalized  effective  resistance  in  a 
generalized  electrical  network.  This  analogy  with  an  electrical 
network  is  the  key  technical  tool  to  prove  Theorem  1.  It 
also  provides  additional  intuition  into  the  problem.  The  next 
section  describes  generalized  electrical  networks  and  presents 
the  associated  technical  results  needed  to  prove  Theorem  1. 

III.  Generalized  Electrical  Networks 

A  generalized  electrical  network  (Q,  R)  consists  of  a  graph 
Q  =  (V.E)  (finite  or  infinite)  together  with  a  function  It  : 
£  — >  Sfe+  that  assigns  to  each  edge  e  G  £  a  symmetric 
positive  definite  matrix  Re  called  the  generalized  resistance 
of  the  edge. 

A  generalized  flow  from  node  u  G  'T’  to  node  v  G  ‘V  with 
intensity  j  e  Rkxk  is  an  edge-function  j  :  £  — >  Rfcxfc  such 
that 

!j  P  =  u 

— j  p  =  v  yp  g  .  (5) 
0  otherwise 

We  say  that  a  flow  *  is  a  generalized  current  when  there  is  a 
node-function  V  :  V  — >  Rfexfc  for  which 

lfu,v'iu,v  —  Vu  G  £.  (6) 

The  node-function  V  is  called  a  generalized  potential  as¬ 
sociated  with  the  current  i.  Eq.  (5)  should  be  viewed  as 
a  generalized  version  of  Kirchoff’s  current  law  and  can  be 
interpreted  as:  the  net  flow  out  of  each  node  other  than  u  and 


v  is  equal  to  zero,  whereas  the  net  flow  out  of  u  is  equal  to 
the  net  flow  into  v  and  both  are  equal  to  the  flow  intensity  j. 
Eq.  (6)  provides  in  a  combined  manner,  a  generalized  version 
of  Kirchoff’s  loop  law,  which  states  that  the  net  potential  drop 
along  a  circuit  must  be  zero,  and  Ohm’s  law,  which  states  that 
the  potential  drop  across  an  edge  must  be  equal  to  the  product 
of  its  resistance  and  the  current  flowing  through  it.  A  circuit 
is  an  undirected  path  that  start  and  end  at  the  same  node.  For 
k  =  1,  generalized  electrical  networks  are  the  usual  electrical 
networks  with  scalar  currents,  potentials,  and  resistors. 

The  following  property  for  the  generalized  electrical  net¬ 
works  is  implicitly  assumed  throughout  this  section. 

Assumption  2  (Generalized  electrical  network):  The  gen¬ 
eralized  electrical  network  (G,R)  is  constructed  from  a  graph 
Q  that  is  weakly  connected  with  a  finite  maximum  node  de¬ 
gree,  and  from  an  edge-resistance  function  R  that  is  uniformly 
bounded,  i.e.,  there  exists  constant  symmetric  positive-definite 
matrices  f?max  such  that  Rmin  <  Re  <  Rmax,  Ve  G  £. 

The  energy  dissipated  by  an  edge-function  j  in  the  network 
(G,  R)  is  defined  by 

||j||:=  (^TV(jeri?eie))5.  (7) 

It  is  straightforward  to  verify  that  the  set  of  edge-functions 
with  finite  dissipated  energy  constitutes  a  Hilbert  space  Hr 
with  inner  product  (j,  j)  =  YYeeE  Tr UlReje),  Vj,j  G  Hr. 
For  infinite  networks,  the  summation  in  (7)  is  an  absolutely 
convergent  series  and  the  order  of  summation  is  irrelevant. 
Flows  of  finite  support  always  belong  to  Hr. 

A.  Existence  and  Uniqueness  of  Generalized  Current 

Existence  and  uniqueness  of  scalar  currents  in  infinite  net¬ 
works  has  been  examined  in  [13,  14].  It  was  shown  by  Flanders 
that,  unlike  in  finite  networks,  in  an  infinite  electrical  network 
the  current  is  not  uniquely  determined  by  Kirchoff’s  laws 
and  Ohm’s  law  [13].  He  showed,  however,  that  uniqueness 
of  current  in  an  infinite  network  can  be  established  if  two 
additional  conditions  are  imposed:  the  current  has  a  finite 
dissipated  energy  and  it  is  the  limit  of  flows  with  finite 
support.  For  this  reason,  in  examining  the  uniqueness  of 
generalized  currents  in  infinite  networks  we  restrict  ourselves 
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to  generalized  flows  that  are  limits  of  finite  support  flows  and 
that  have  finite  dissipated  energy.  For  finite  networks  these 
conditions  hold  trivially. 

The  following  theorem  establishes  existence,  uniqueness, 
and  linearity  of  generalized  currents  and  potential  differences 
in  generalized  electric  networks.  The  proof  of  this  result  is 
provided  in  Appendix  I. 

Theorem  2  (Generalized  Current):  For  every  pair  of  nodes 
u,v  £  V  and  intensity  i  £  Rfcxfe,  among  all  flows  that  have 
finite  dissipated  energy  and  are  limits  of  finite  support  flows, 
there  exists  a  unique  current  i  from  u  to  v  with  intensity  i.  In 
addition, 

1)  the  current  is  the  flow  that  minimizes  the  energy  dis¬ 
sipation,  among  all  flows  from  node  u  to  node  v  with 
intensity  i,  that  are  limits  of  finite  support  flows,  and 

2)  the  current  i  and  the  potential  difference  Vu  —  Vv  (for  ev¬ 
ery  u.  v  £  ‘If)  are  linear  functions  of  the  intensity  i.  The 
potential  is  unique  only  up  to  an  additive  constant.  □ 

It  was  previously  known  that  in  a  scalar  electrical  network, 
the  current  minimizes  energy  dissipation.  This  result  is  known 
as  Thomson’s  Minimum  Energy  Principle  [12,  14],  Theorem  2 
shows  that  generalized  currents  also  obey  Thomson’s  Principle 
in  both  finite  and  infinite  networks. 

B.  Generalized  Effective  Resistance 

It  was  shown  in  the  previous  section  that  the  potential 
difference  Vu  —  Vv  £  Rfcxfc  associated  with  a  current  of 
intensity  i  £  R.kxk  flowing  from  u  to  v  is  a  linear  function  of 
i.  It  turns  out  that  this  linear  map  can  be  expressed  through 
the  matrix  multiplication  by  a  k  x  k  matrix,  which  is  stated 
next.  The  proof  of  this  result  is  provided  in  Appendix  I. 

Lemma  1:  Let  (Q .  R)  be  a  generalized  electric  network 
satisfying  Assumption  2.  The  linear  mapping  between  i  and 
Vu  —  Vv  can  be  defined  by  multiplication  by  a  k  x  k  ma¬ 
trix,  which  we  call  the  generalized  effective  resistance  Re^v 
between  u  and  v : 

Vu-Vv  =  <t,i,  Vi  £  Rkxk.  □ 

In  the  sequel,  we  will  refer  to  generalized  effective  resis¬ 
tance  simply  as  effective  resistance.  In  view  of  Lemma  1, 
the  effective  resistance  between  two  nodes  is  the  potential 
difference  between  them  when  a  current  with  intensity  / /.,  the 
k  x  k  identity  matrix,  is  injected  at  one  node  and  extracted  at 
the  other,  which  is  analogous  to  the  definition  of  effective 
resistance  in  scalar  networks  [12],  Moreover,  the  effective 
resistance  is  a  symmetric  positive-definite  matrix.  To  show 
this,  we  will  need  the  following  technical  result  (also  proved 
in  Appendix  I),  which  will  have  additional  usefulness  in  the 
sequel. 

Lemma  2:  Let  i  £  TLr  be  the  unique  current  in  the  network 
(Q,  R)  with  intensity  i  e  Rfcxfc  from  u  to  v,  and  let  j  be  a  flow 
with  intensity  j  £  Rfcxfe  from  u  to  v  that  can  be  expressed  as 
a  limit  of  finite  support  flows.  Then, 

YJiTeReje  =  {Vu~Vv)T  j, 

eSE 


where  V  is  a  generalized  potential  associated  with  the  current 
i.  Moreover,  the  series  in  the  left-hand  side  converges  abso¬ 
lutely,  meaning  that  each  one  of  the  k 2  series  that  constitute 
the  matrix-valued  left  hand  side  converges  absolutely.  □ 

To  prove  positive-definiteness  of  effective  resistances,  set 
j  =  i  in  Lemma  2,  where  both  i  and  j  have  intensity  / /. ,  to 
obtain 

^Reie  =  (K  -  Vv)T  =  (R^vf ,  (8) 

e£!E 

where  the  second  equality  follows  from  the  definition  of 
effective  resistance  in  Lemma  1.  Since  all  the  generalized 
edge-resistances  Re  are  symmetric  and  positive-definite,  we 
conclude  that  the  left-hand  side  must  be  symmetric  and 
positive-definite,  which  confirms  that  effective  resistances  are 
indeed  symmetric  positive-definite. 

C.  Rayleigh’s  Monotonicity  Law 

The  next  result  relates  the  effective  resistances  of  two 
distinct  networks  related  by  an  appropriate  partial  order.  A 
similar  result  for  finite  scalar  networks,  called  Rayleigh’s 
Monotonicity  Law  [12],  states  that  if  the  edge-resistances  in 
a  scalar  electrical  network  are  increased  (perhaps  even  made 
infinity,  i.e.,  an  open  circuit),  then  the  effective  resistance 
between  every  pair  of  nodes  in  the  network  can  only  increase. 
For  a  long  time,  Rayleigh’s  Monotonicity  Law  was  considered 
so  evidently  true  that  no  proof  was  deemed  necessary.  Never¬ 
theless,  Doyle  and  Snell  [12]  provided  a  proof,  which  we  now 
extend  to  generalized  electrical  networks. 

Theorem  3  ( Generalized  Rayleigh’s  Monotonicity  Law): 
Consider  two  generalized  electrical  networks  (Q,  R)  and 
(Q,  R)  for  which  Q  C  Q  and  Re  >  Re  for  every  e  £  £.  For 
every  pair  of  nodes  u,  v  of  Q , 

oeff  \  oeff 

-**"14, —  -^U^V  ’ 

where  and  Re^v  are  the  effective  resistances  between  u 
and  v  in  the  networks  (G,R)  and  ( G,R ),  respectively.  □ 

Proof  of  Theorem  3.  Let  i  :  £  — >  Rfexfe  and  i  :  £  — +  R.kxk 
be  the  currents  from  u  to  v  in  the  networks  ( Q ,  R)  and  (Q,  R), 
respectively,  both  with  intensity  i  £  Rfcxfe.  Defining  j  :  £  — > 
R kxk  to  be  the  following  “extension”  of  the  current  i  to  the 
graph  G 

ie  e  €  £ 

0  e  G  £  \  £ 

we  conclude  that  j  satisfies  the  conservation  law  (5)  for 
the  network  (Q .  R)  and  is  therefore  a  flow  for  this  network 
(although  not  necessarily  a  current).  Since  according  to  Theo¬ 
rem  2  the  current  i  is  the  flow  of  minimum  dissipated  energy 
for  the  network  ((?,  R),  we  conclude  that 

Tr (^TifiUe)  <TrC£  jjReJe) 

ee!E  eS£ 

=  Tr 

<  Tr (^2  i^Reie), 

e6£ 
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where  the  equality  is  a  consequence  of  the  definition  of  j  and 
the  last  inequality  follows  from  the  fact  that  R,  <  Re,  Ve  G 
From  this.  Lemma  2,  and  the  definition  of  effective  resistance, 
we  conclude  that 


Tr(i  R%v  i)  <  TRi1  R^v i), 
for  every  i  G  Rfcxfc,  from  which  the  result  follows. 


D.  Approximating  Infinite  Network  Currents 

The  next  theorem  shows  that  currents  and  effective  re¬ 
sistances  in  an  infinite  network  can  be  approximated  with 
arbitrary  accuracy  by  those  in  a  sufficiently  large  but  finite 
subnetwork.  A  similar  result  for  the  usual  scalar  electrical 
networks  was  established  by  Flanders  [13,  14],  The  proof 
of  the  theorem,  which  is  inspired  by  [13],  is  provided  in 
Appendix  I. 

Theorem  4  (Finite  Approximation):  Let  ( Q,R )  be  a  net¬ 
work  satisfying  Assumption  2,  {G^}  a  nested  sequence  of 
finite  graphs  satisfying  Assumption  1,  and  u,v  two  arbitrary 
nodes  that  appear  in  every  graph  Q('n> .  For  a  given  intensity 
i  G  Rfcxfc,  let  i  and  i denote  the  currents  from  node  u  to 
node  v  in  the  infinite  network  (Q.  R)  and  in  the  finite  network 
(G^n\R),  respectively.  Then, 

lim  i ^  =  i, 

n — »oo 

where  convergence  is  in  the  7f#-norm.  In  addition,  denoting 
by  and  R^vn>  the  effective  resistances  between  nodes  u 
and  v  in  the  networks  ( G,R )  and  (G^n\R),  respectively,  we 
have 


lim  Rf^  =  R 


eff 
u,v  * 


□ 


This  result  will  be  instrumental  in  showing  that  the  BLU 
estimator  error  covariances  in  large  finite  networks  converge 
to  the  effective  resistance  in  the  limiting  infinite  network. 


IV.  Electrical  Analogy  and  Proof  of  Theorem  1 

We  start  by  establishing  the  electrical  analogy  for  finite 
networks.  The  proof  of  Theorem  1  is  then  provided,  which 
uses  these  results. 


A.  BLU  Estimation  in  Finite  Networks 

The  analogy  between  BLU  estimation  in  a  finite  measure¬ 
ment  network  and  the  corresponding  electrical  network  is 
stated  in  the  next  theorem. 

Theorem  5  (Finite  Electrical  Analogy):  Let  ( G,P )  be  a 
measurement  network  with  a  finite  weakly  connected  graph 
G  =  (‘F’,  £)  and  an  edge-covariance  function  P  :  £  — >  §fc+, 
with  node  o  as  the  reference  node.  For  every  node  u  G  *F’\{o}, 
the  following  statements  hold. 

1)  The  BLU  estimator  C  of  xu  in  the  finite  measurement 
network  (G  ■  P)  is  equal  to  the  current  i  with  identity 
intensity  Ip-  in  the  generalized  electrical  network  (G,P) 
from  u  to  o. 


2)  The  covariance  Du,o  of  the  BLU  estimation  error  xu—xu 
is  equal  to  the  effective  resistance  Rff0  between  the  node 
u  and  the  reference  node  o.  □ 


To  prove  this  theorem,  we  need  the  next  lemma  which  shows 
that  in  a  finite  network,  an  unbiased  estimator  must  be  a  flow. 
The  proof  of  the  lemma  is  provided  in  Appendix  I. 

Lemma  3  (Unbiased  Estimator):  In  a  finite  measurement 
network  (G,  P)  with  a  reference  node  o,  an  edge  function  j  is 
a  linear  unbiased  estimator  of  a  node  variable  xu  if  and  only 
if  j  is  a  flow  of  intensity  Ip-  from  node  u  to  the  reference  node 
o.  In  this  case,  the  covariance  of  the  error  in  the  estimate  xu 
is  given  by 

tCu)(xu  Xu )  ]  ^  '  j e  Peje •  E- 1 

e£!E 

Note  that  we  have  used  xu  above  to  distinguish  the  estimate 
from  the  BLU  estimate  xu  of  the  node  variable  xu.  The 
next  result  provides  a  necessary  and  sufficient  condition  for 
the  existence  of  linear  unbiased  estimators  in  finite  networks, 
whose  proof  is  provided  in  Appendix  I. 

Lemma  4:  For  a  finite  measurement  graph  G  =  (‘F’,  £) 
with  a  reference  node  o  G  ' V,  there  exists  an  unbiased 
estimator  for  every  node  variable  xu,  u  G  V  \  {o}  if  and 
only  if  G  is  weakly  connected.  □ 

The  previous  result  explains  the  need  for  the  assumption  of 
weak  connectivity.  We  are  now  ready  to  prove  Theorem  5. 

Proof  of  Theorem  5.  From  the  Unbiased  Estimator  Lemma  3 
and  the  definition  of  energy  dissipation  (7),  we  see  that  in  a 
finite  network  (G,  P)  with  reference  node  o,  the  BLU  estimator 
C  of  node  variable  xu  is  given  by 

C  =  arg  min  ||j|| 

subject  to:  j  is  a  flow  of  intensity  R  from  u  to  o. 


Comparing  with  the  electrical  network  problem,  we  conclude 
from  Theorem  2  that  the  BLU  estimator  C  of  xu  is  the  current 
i  of  intensity  Ip-  from  u  to  o  in  the  generalized  electrical 
network  (G  ■  P ),  which  proves  the  first  statement. 

Since  C  =  i,  it  follows  from  Unbiased  Estimator  Lemma  3 
that  the  covariance  of  xu’s  BLU  estimation  error  is  given  by 


£ 


14,0 


iT p  i  —  ReS 
/  ,  le  -re‘e  —  lxu,o 

ee£ 


where  the  second  inequality  follows  from  (8),  which  proves 
the  second  statement.  ■ 


B.  Computation  of  the  BLUE  in  Finite  Networks 

In  this  section  we  provide  explicit  formulas  for  computing 
the  BLU  estimates  and  the  covariances,  and  remark  on  dis¬ 
tributed  computation  of  the  estimates  for  sensor-network  ap¬ 
plications.  Consider  a  finite  measurement  graph  G  =  (‘ F’,  £) 
with  I'F’I  =  N  nodes  and  \rE\  =  M  edges.  Without  loss  of 
generality,  let  x0  =  0  and  the  reference  node  o  be  indexed  by  1 
and  the  nodes  with  unknown  node  variables  indexed  2  through 
N.  To  express  the  relationship  between  the  variables  and  the 
measurements  in  a  compact  form,  we  use  the  definition  of  the 
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Fig.  2.  A  measurement  Graph  (y  with  node  1  as  the  reference  node,  its  generalized  incidence  matrix  A.  and  the  generalized  basis  incidence  matrix  Ai, 
constructed  w.r.t.  the  reference  node.  The  (block)  row  and  (block)  column  indices  of  A  correspond  to  node  and  edge  indices,  respectively. 


incidence  matrix  of  a  graph  from  [15].  The  incidence  matrix 
A  of  a  directed  graph  £7  consisting  of  N  nodes  and  M  edges 
is  an  TV  x  M  matrix,  with  one  row  per  node  and  one  column 
per  edge.  It  is  defined  by  A  :=  [aue],  where  aue  =  1  is  if  the 
edge  e  is  incident  on  the  node  u  and  directed  away  from  it, 
«u,e  =  —  1  if  e  is  incident  on  u  but  directed  toward  it,  and 
au,e  =  0  if  e  is  not  incident  on  u.  We  define  the  generalized 
incidence  matrix  as 

A:=  A®Ik  £RkNxkM,  (9) 

where  <g)  denotes  the  Kronecker  product.  Figure  2  shows  an 
example  of  a  generalized  incidence  matrix. 

Let  x  =  [x^  ,  xj , . . . ,  xJj]T  £  ]Rfc(Ar~1)  the  vector  of  all 
the  unknown  node  variables.  By  stacking  together  all  of  the 
measurements  into  a  single  vector  z  =  [zf ,  zj .... ,  ,zJf]T  £ 
and  all  the  measurement  errors  into  a  vector  e  = 
[ef , . . . ,  e^f]T  £  MfcM,  we  can  express  all  of  the  measurement 
equations  (1)  in  the  compact  form 

z  =  Abx.  +  e,  Ab  ■■=  Ab  <gi  4,  (10) 

where  Ab  is  the  basis  incidence  matrix  of  £7,  defined  as  the 
submatrix  of  the  incidence  matrix  A  obtained  after  removing 
the  row  corresponding  to  the  reference  node  o.  In  general, 
a  basis  incidence  matrix  of  a  directed  graph  is  obtained  by 
removing  any  row  of  the  incidence  matrix  [15].  We  call  the 
matrix  At,  defined  in  (10)  the  generalized  basis  incidence  ma¬ 
trix  of  Q.  We  further  construct  £A  :=  diag(Pi,  P2, . . . ,  Pm)  € 

RkMxkM 

as  the  block  diagonal  square  matrix  of  all  the 
measurement  error  covariances.  Figure  2  shows  an  example  of 
a  generalized  basis  incidence  matrix.  The  next  result  provides 
explicit  formulas  for  computing  the  BLU  estimates  and  error 
covariances  in  finite  graphs. 

Theorem  6:  Consider  a  finite  measurement  network  (£7,  P ) 
satisfying  Assumption  2  with  a  graph  £7  =  ('P,  £E).  Let  the 
reference  node  o  be  indexed  by  1,  and  the  vectors  x,  z,  e  and 
the  matrices  Abl  £A  be  constructed  as  described  above.  Then, 
the  BLU  estimate  of  x  is  given  by 

x  =  £^1A^_1z,  Cb  :=  Ab^l~1Ab  ,  (11) 

and  the  error  covariance  by 

E  :=  E[(x  —  x)(x  —  x)T]  =  Cf1.  □ 

Proof  of  Theorem  6.  A  basis  incidence  matrix  constructed  by 
removing  an  arbitrary  row  from  the  incidence  matrix  of  a 
graph  has  full  row  rank  if  and  only  the  graph  is  weakly 
connected  [15].  It  follows  from  Assumption  2  that  the  gen¬ 
eralized  basis  incidence  matrix  Ab  of  the  measurement  graph 
£7  also  has  full  row  rank.  Assumption  2  also  ensures  that 
SA  >  0;  hence  Cb  is  positive-definite.  The  statements  then 


follow  from  standard  results  in  least  squares  estimation  applied 
to  the  measurement  model  (10)  (see,  e.g.,  [16]).  ■ 

It  follows  from  the  theorem  above  that  the  BLU  covariances, 
and  therefore  the  generalized  effective  resistances,  can  be 
determined  by  computing  the  inverse  of  Cb.  In  the  special 
case  when  k  =  1  and  fiA  =  /,  Cb  turns  out  to  be  the 
Dirichlet  Laplacian  matrix  of  the  graph  £7  with  the  reference 
node  o  node  as  the  boundary  [17].  For  this  reason,  we  call 
Ci,  in  (11)  the  generalized  Dirichlet  Laplacian  matrix  of  the 
finite  network  ( £7,P ).  Due  to  the  structure  of  the  matrix  Cb, 
the  equation  £hx  =  b  is  amenable  to  parallel  iterative  methods 
for  solving  linear  equations.  Such  techniques  are  used  in  [7] 
to  devise  distributed  algorithms  to  compute  the  BLU  estimate 
x,  in  which  every  node  computes  its  own  variable’s  estimate 
and  the  information  needed  to  carry  out  the  computation  is 
obtained  by  communicating  with  its  neighboring  nodes. 


C.  Proof  of  the  main  result 

Theorem  1  can  now  be  proved  using  the  tools  developed  so 
far. 


Proof  of  Theorem  1.  We  will  prove  the  statements  of  the 
theorem  in  reverse  order. 

(n) 

Since  the  sequence  of  BLU  covariances  E„;t,  is  the  same  as 
the  sequence  of  effective  resistances  (  Finite  Electrical 

Analogy  Theorem  5),  and  the  sequence  Ruf  converges  to 
the  effective  resistance  P®ff0  in  the  infinite  network  (Finite 
Approximation  Theorem  4),  we  have 


neft(n) 

-*■  *"11  n 


peff _ y 

JXu.o  ‘  ^ u.o • 


Moreover,  by  the  construction  of  the  nested  sequence  {£7^}, 
if  ti\  <  712,  then  g(nA  q  (j(n2\  and  so  by  the  Generalized 
Rayleigh’s  Monotonicity  Law  (Theorem  3), 


E(i)  >  ^(2)  > 
u,o  —  u,o  —  - 


from  which  the  third  statement  of  the  theorem  follows. 

Moreover,  the  BLU  estimator  of  in  the  finite  network 
(£("■), P)  is  equal  to  the  current  i ^  in  the  generalized  elec¬ 
trical  network  (£7,  P)  (Finite  Electrical  Analogy  Theorem  5), 
and  the  currents  converge  to  the  unique  current  i  in  the 
electrical  network  (£7,  R)  (Finite  Approximation  Theorem  4). 
Therefore 


(?(”)  =  i{n)  —>  i  =:  C, 

where  the  convergence  is  in  the  Tip- norm.  This  proves  the 
second  statement. 
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By  definition  of  the  BLU  estimator,  we  get 


V.  BLUE  Covariance  in  Lattices 


£(u]  =  CP?qT(xP  ~xq  +  ep,q) 

{p,q)e£(n'> 

=  xu+  J2  CpT^  (12) 

(P>«)  e£("> 

where  the  second  equality  follows  from  unbiasedness,  since 
otherwise  the  expectation  of  the  left  hand  side  would  not  be 
equal  to  xu.  Let  n  <  l,  so  that  from  Assumption  1,  C 
Q"\  It  follows  from  the  uncorrelated-ness  of  the  e’s  and  (12) 
that 

e  [(^)-4”))(4°-4n)n  = 

E  (Cel)  -CW)TPe{CW  -CW), 

ee£<!> 

where  we  have  used  the  convention  that  Ce  =  0  if  e  € 
£(0  \  £(").  This  leads  to 

TV(EpW  -xi"))T])  =  II 

where  ||  •  ||  is  the  Hp- norm.  Since  C (n)  — >  i,  ||C(^  —  ||  — > 

0  as  n,  m  — »  oo.  Therefore, 

lim  sup Tr  (e[(*W  -  -  ^n))T])  =  «•  (13) 

n^°°  l>n  V  ' 

We  recall  that  a  sequence  of  random  variables  { r/n }  converges 
in  the  mean  square  sense  if  and  only  if  (proposition  6.3  in  [18]) 

lim  sup  E[  \t)i  —  ?7rj  | 2 ]  =  0. 

n,l->oo  i>n 

Therefore,  the  sequence  of  random  vectors  Xu  >  converge 
entry-wise  in  the  mean  square  sense.  This  proves  the  first 
statement  and  completes  the  proof  of  Theorem  1 .  ■ 

Remark  1  (Role  of  edge  directions):  Effective  resistances 
are  independent  of  the  directions  of  the  edges  in  the  graph. 
Reversing  the  direction  of  an  edge  e  simply  reverses  the  sign 
of  the  current  ie  on  that  edge.  It  follows  from  (8)  that  the 
effective  resistance  between  any  two  nodes  is  unaffected  by 
the  edge-directions.  Therefore,  all  results  in  this  paper  that 
use  the  graph  partial  order  defined  in  Assumption  1  also  hold 
when  Q  C  Q  is  understood  to  mean  that  the  graph  Q  can  be 
embedded  in  the  graph  Q,  which  means  that  (1)  the  nodes  of 
Q  can  be  mapped  injectively  into  the  nodes  of  Q;  and  (2)  for 
every  edge  e  =  (u,  v)  in  Q ,  there  is  a  corresponding  edge  e 
in  Q  that  is  incident  on  the  nodes  u  and  v,  where  u  and  u 
correspond  to  u  and  v,  respectively,  but  edge  directions  need 
not  be  preserved. 

It  follows  from  the  electrical  analogy  that,  although  a  mea¬ 
surement  graph  is  directed  because  of  the  need  to  distinguish 
between  a  measurement  of  xu  —  xv  and  that  of  xv  —  xu,  the 
BLU  error  covariance  is  independent  of  the  edge  directions. 

□ 


In  this  section  we  look  at  certain  special  classes  of  infinite 
graphs,  namely,  lattices,  for  which  the  effective  resistance 
between  two  nodes  can  be  analytically  derived.  Since  we 
can  exactly  compute  the  effective  resistance,  we  know  the 
minimum  possible  variance  achievable  in  these  graphs.  A 
numerical  study  is  also  presented  for  lattices  to  examine  the 
rate  at  which  the  BLU  estimator  variances  in  a  nested  sequence 
of  finite  subgraphs  converge  to  the  minimum  possible  value 
as  the  subgraphs  increase  in  size. 

A.  Effective  Resistance  in  Lattices 

The  d-dimensional  square  lattice  Z,/  is  defined  as  a  graph 
with  a  node  in  every  point  in  R'/  with  integer  coordinates  and 
an  edge  between  every  pair  of  nodes  at  an  Euclidean  distance 
equal  to  one.  Edge  directions  are  arbitrary  since  they  play  no 
role  in  the  effective  resistance,  and  therefore  in  the  estimation 
error  covariances  (see  Remark  1).  We  construct  a  generalized 
electrical  network  by  assigning  a  constant  matrix-resistance  to 
every  edge  of  Z^. 

The  following  lemma  establishes  the  effective  resistance  of  a 
d-dimensional  square  lattice.  The  graphical  distance  dg(u,v) 
between  two  nodes  u  and  v  in  a  graph  Q  is  the  minimum 
number  of  edges  one  has  to  traverse  in  order  to  go  from  u 
to  v,  without  necessarily  respecting  the  edge  orientations.  The 
graphical  distance  in  the  lattice  Z d  is  denoted  by  dzd(-,  •). 

Lemma  5:  Consider  the  electrical  network  (Z d,Ro)  with 
the  same  generalized  resistance  Ra  £  §fc+  at  every  edge 
of  the  d-dimensional  square  lattice.  The  generalized  effective 
resistance  between  two  nodes  u  and  v  in  the  electrical 
network  (Z d,Ro)  satisfies 

1)  RfJZ1)  =  Q(dZl(u,v)) 

2)  Rf  (Z2)  =  e(logdZ2(u,v)), 

3)  Z3)  =  0(1).  □ 

The  usual  asymptotic  notation  O(-)  is  used  with  matrix  valued 
functions  in  the  following  way.  For  two  functions  g  :  R  — > 
Rfcxfe  and  /  :  R.  — >  R,  the  notation  g(z)  =  Q(f(z))  means 
there  exists  a  constant  zQ  and  two  matrices  A,Bg  E>k+  that 
are  independent  of  z  such  that  Af(z)  <  g(z)  <  Bf(z)  for  all 
z  >  za. 

Note  that  the  Generalized  Current  Theorem  2  guarantees 
that  effective  resistances  in  infinite  lattice  networks  are  well 
defined.  The  results  in  Lemma  5  are  established  by  extending 
known  results  on  the  scalar  effective  resistance  in  the  d- 
dimensional  square  Lattice  to  the  generalized  case. 

The  next  result,  whose  proof  is  provided  in  Appendix  I,  is 
needed  for  the  proof  of  Lemma  5. 

Lemma  6:  For  a  given  graph  Q  with  finite  maximum  node 
degree,  let  denote  the  scalar  effective  resistance  between 
two  nodes  u  and  v  in  an  a  scalar  electrical  network  (G- 1)  that 
has  1-Ohm  resistors  on  every  edge  of  the  graph  Q.  Let  (Q .  Ra ) 
be  a  generalized  electrical  network  constructed  from  the  same 
graph  Q  by  assigning  a  generalized  resistance  Ra  £  Sk+  to 
every  edge  of  Q.  Then, 


Scaling  laws  for  the  effective  resistances  in  scalar  lattice 
networks  are  stated  in  the  next  result,  which  follows  from  the 
results  established  in  [19,  20], 

Lemma  7:  Consider  the  electrical  network  (Z^,  1)  with 
the  same  scalar  resistance  1-Ohm  at  every  edge  of  the  d- 
dimensional  square  lattice.  The  scalar  effective  resistance  r^fv 
between  two  nodes  u  and  v  in  the  electrical  network  (Zd,  1) 
satisfies 

1)  rf  (Z1)  =  e(dZl(u,v)) 

2)  rf  (Z2)  =  0(logdz2(u,v)), 

3)  rt*(Z3)  =  e(l).  □ 

Lemma  5  now  follows  from  Lemma  7  and  Lemma  6. 

B.  Convergence  Rate 

Theorem  1  shows  that  the  BLU  estimator  error  variance  in  a 
sequence  of  nested  finite  subgraphs  of  an  infinite  measurement 
graph  converges  to  a  limiting  variance  that  is  numerically  equal 
to  an  effective  resistance,  regardless  of  how  the  sequence  (?(") 
is  constructed.  However,  the  rate  at  which  the  covariances 
converge  to  the  effective  resistance  in  the  infinite  graph  will 
depend  on  how  the  sequence  { Q<n) }  is  constructed  vis-a-vis 
the  nodes  u  and  o.  One  natural  way  to  construct  the  graph 
g(n)  _  £("))  is  to  take  ‘L'M  to  contain  all  nodes 

that  are  at  a  graphical  distance  smaller  than  a(n)  from  the 
shortest  path  connecting  u  and  o,  where  a(-)  is  a  positive 
and  increasing  function.  The  distance  of  a  node  from  a  path 
denotes  the  minimum  graphical  distance  between  the  node  and 
any  node  on  the  path.  If  there  are  multiple  shortest  paths,  we 
take  the  union  of  the  sets  obtained  for  each  shortest  path.  £  <n'> 
is  then  chosen  as  the  set  of  edges  that  are  incident  on  the  nodes 
in  ‘L’ ■”-) .  This  construction  satisfies  Assumption  1. 

Figure  3(a-c)  shows  the  first  three  members  of  a  sequence 
of  nested  subgraphs  { z!,": }  of  the  2-dimensional  lattice  Z2, 
constructed  according  to  the  procedure  outlined  above,  with 
a(n)  =  n.  For  simplicity,  we  consider  the  case  of  scalar 
variables  and  measurements,  and  every  measurement  error  is 
assumed  to  have  a  variance  1.  Covariances  for  vector- valued 
variables  could  be  obtained  using  Lemma  6.  Figure  3(d)  shows 
the  plot  of  the  variances  si"]  of  node  u  in  the  measurement 
network  (Z^  ,1)  as  a  function  of  n.  The  limiting  value  of 
the  variance  is  the  effective  resistance  between  u  and  o  in 
the  infinite  lattice  Z2.  In  an  infinite  2-dimensional  lattice  with 
unit  resistance  on  every  edge,  the  effective  resistance  between 
two  nodes  u  with  relative  x  and  y  coordinates  is  given  by 
Rf,o  =  £(log  logs),  where  7  «  0.577  [19], 

For  the  example  in  Figure  3(a-c),  x  =  4,  y  =  0,  so  the 
limiting  variance  for  node  u  is  EUj0  =  «  0.956,  which 

is  shown  by  a  dotted  line  in  the  Figure  3(d).  As  expected, 
the  variances  E monotonically  decrease  and  approach  the 
asymptotic  value  as  n  increases. 

For  a  given  nested  sequence  Q^n\  the  convergence  rate  of 
E^")  to  E  will  depend  on  the  graphical  distance  dU}0  between 
nodes  u  and  o.  Taking  this  into  account,  we  can  construct  the 
sequence  g(n)  by  choosing  'lA")  as  the  set  of  nodes  that  are 
within  a  graphical  distance  of  j3{n)dU)0  of  the  shortest  path 
connecting  u  and  o,  where  /?(•)  is  a  positive  and  increasing 


function.  Numerical  studies  on  the  2-dimensional  lattice  Z2 
indicate  that  with  this  construction,  the  ratio  ||Eu"o||/||EU)0|| 
depends  only  on  the  value  of  [3  and  is  independent  of  dUtQ. 
Figure  3(e)  shows  the  ratio  j]E«”o||/||EU)0|]  as  a  function  of 
P  for  three  different  nodes  taken  at  distances  of  2,  4  and 
8,  respectively,  from  o.  The  figure  shows  that  the  rate  of 
convergence  of  E i”o  to  the  limiting  value  E„j0  is  not  sensitive 
to  the  distance  between  u  and  o.  In  particular,  with  {3  =  2,  the 
error  between  E^n)  and  E  is  less  than  10%.  These  studies  show 
that  in  a  2-dimensional  lattice,  a  relatively  small  subgraph 
is  sufficient  to  obtain  an  estimate  whose  variance  is  quite 
close  to  the  minimum  possible  achievable  by  using  all  the 
measurements.  For  an  arbitrary  measurement  graph,  as  long  as 
the  graph  is  “close  to”  a  lattice  in  an  appropriate  sense,  similar 
trends  are  expected.  For  details  on  appropriate  measures  of 
closeness  to  lattices,  the  reader  is  referred  to  [11]. 

VI.  Summary 

The  problem  of  estimating  vector-valued  node  variables 
from  noisy  relative  measurements  naturally  arises  in  many  ap¬ 
plications  that  have  a  graphical  structure,  such  as  localization 
in  sensor  networks  and  motion  consensus  in  swarms  of  mobile 
agents.  In  this  paper  we  obtained  a  characterization  on  the 
covariance  of  the  minimum  possible  estimation  error  when  an 
arbitrarily  large  number  of  measurements  is  available.  This 
covariance  was  shown  to  be  equal  to  a  matrix-valued  effective 
resistance  in  an  infinite  electrical  network.  We  also  showed 
that  when  the  measurement  graph  has  bounded  node  degree, 
the  error  covariance  of  the  estimate  produced  by  using  only  a 
finite  subset  of  measurements  converge  to  the  error  covariance 
of  the  estimate  that  could  be  obtained  by  using  all  the  available 
measurements. 

The  convergence  results  established  in  this  paper  provide  the 
formal  justification  for  treating  large  finite  graphs  as  infinite 
graphs,  which  can  be  used  to  obtain  asymptotic  bounds  on 
the  estimation  error.  Preliminary  work  on  determining  such 
asymptotic  error  bounds  for  infinite  graphs  has  been  reported 
in  [11].  Further  work  on  establishing  scaling  laws  using  the 
tools  developed  in  this  paper  is  under  way.  Furthermore,  the 
matrix-valued  effective  resistance  is  also  relevant  in  several 
other  distributed  control  problems  [6],  The  tools  developed 
in  the  paper  are  therefore  useful  in  answering  scalability 
questions  in  certain  distributed  control  problems  as  well. 

Another  implication  of  the  convergence  results  established 
in  this  paper  is  that  for  estimation  problems  based  on  rel¬ 
ative  measurements,  after  a  certain  point,  considering  more 
measurements  will  only  marginally  improve  the  quality  of  the 
estimate.  This  observation  may  be  of  interest  to  designers  of 
distributed  estimation  algorithms,  since  it  shows  that  accurate 
estimation  is  possible  by  considering  a  relatively  small  subset 
of  measurements  among  all  the  available  ones.  Developing 
such  algorithms,  and  methods  to  choose  the  best  possible 
subset  of  measurements,  are  topics  for  future  research. 

Our  problem  formulation  assumes  zero-mean  measurement 
noise.  If  this  is  not  the  case,  BLU  estimators  produce  biased 
estimates.  In  fact,  it  may  happen  that  the  bias  increases  as 
the  number  of  measurements  increases,  which  could  provide 
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(d)  Variance  E^o  of  in  (Z2n  ,  1)  as  a 
function  of  n  (shown  in  circles),  and  the  value 
of  the  effective  resistance  between  u  and  o  in 
the  infinite  lattice  Z2  (shown  as  a  dotted  line). 


(e)  The  ratio  ||E^o||/||EUj0||  as  a  function  of  (3 
for  three  different  node  pairs  u,o  in  the  nested 

Z(n) 

2  • 


(n)  ...  .  (n) 

Fig.  3.  (a)-(c)The  first  three  members  of  a  sequence  of  nested  subgraphs  Z2  of  the  2-dimensional  lattice  Z2,  and  (d)  the  plot  of  variances  E ^,0  in  the 
sequence  of  measurement  networks  1)  as  a  function  of  n.  The  variance  in  the  nested  finite  subgraphs  monotonically  decrease  toward  the  limiting  value 

as  the  subgraphs  increase  in  size,  (e)  Trend  of  the  ratio  of  variance  in  the  finite  subnetworks  (zif\  1)  to  the  minimum  possible  variance  in  (Z2, 1),  as  a 
function  of  /3(n)  for  three  different  node  pairs  u,  o,  when  the  node  set  ‘P-n>  is  chosen  so  as  to  encompass  all  nodes  within  a  radius  of  /3 (n)dUj0  from  the 
shortest  path  connecting  u  and  o  . 


additional  justification  for  using  only  a  small  subset  of  the 
available  measurements.  A  detailed  study  of  the  impact  of 
measurement-noise  bias  remains  a  problem  for  future  research. 
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Appendix  I 
Proofs 


We  first  introduce  some  terminology.  Define  a  norm  for  all 
node-functions  u>  :  ‘if  — >  Rfcxfe  as 


Tr  {uluv 


where  ||  •  ||  p  denotes  the  Frobenius  norm  of  a  matrix,  and 
a  linear  vector  space  S,p  as  the  space  of  all  bounded  node¬ 
functions  with  respect  to  the  above  defined  norm: 


Sp  =  {u>:  ‘lf->Rkxk\  ||w||<oo}.  (15) 


where  au>e  is  nonzero  if  and  only  if  the  edge  e  is  incident 
on  the  node  u  and  when  nonzero,  au.e  =  —  1  if  the  edge  e 
is  directed  towards  u  and  au.e  =  1  otherwise.  The  incidence 
operator  s/J  is  simply  an  extension  to  infinite  graphs  of  the 
generalized  incidence  matrix  defined  in  Section  IV-A  [see  (9)] 
for  finite  graphs.  The  series  in  (16)  is  absolutely  convergent 
since  it  involves  only  a  finite  number  of  terms  due  to  the 
bounded  degree  of  Q. 

We  call  a  node-function  u>  £  S,p  a  divergence  for  the  graph 
Q  if  uj  has  finite  support  and  =  0.  One  can  view  a 

divergence  as  an  assignment  of  flow  sources  at  a  finite  number 
of  nodes  of  the  graph  so  that  total  flow  into  the  graph  is  equal 
to  the  total  flow  out  of  it. 


An  edge-function  j  £  Ur.  is  called  a  flow  in  Q  with 
divergence  ui  £  Sq/  if  to  is  a  divergence  in  Q  and  j  satisfies 

y '  ju,v  y  ^  jv,u = Vu  £  ‘if .  (i7) 

(ti,u)£E  (u,ii)£E 

u—u  u—u 

The  condition  (17)  can  be  compactly  represented  as 

sfj  =  u.  (18) 

An  edge-function  j  £  Ur,  is  called  a  circulation  in  (Q,  R)  if 
sfj  =  0.  (19) 


In  other  words,  a  circulation  is  an  element  of  U r  that  belongs 
to  the  null  space  of  sV . 

First  we  show  that  the  linear  operator  sf  :  Ur  — >  Sqp 
defined  above  is  bounded.  Since  for  each  u  £  If,  {Aj)u  £ 
Rkxk,  we  have 

WWUf  =  II  £  nielli  <  £  Ibell! 

ee£u  ee£» 


where  is  the  set  edges  in  £  that  are  incident  on  u.  It  can  be 
shown  from  the  relationship  between  the  Frobenius  norm  and 
the  singular  values  of  a  matrix  that  for  every  edge  e  £  £,  we 
have  |be||F  <  j^—Tv(jjReje),  where  Amin  is  the  uniform 
lower  bound  on  the  smallest  eigenvalue  of  Re,  Ve  £  £. 
Existence  of  a  positive  Amin  is  guaranteed  by  Assumption  2. 
Since  the  above  is  true  for  every  u  £  ‘If,  from  (14)  we  get 

\Wj\\2  =  £  I \(^j)u\\2F  <  y—  £  £  Tr (jjReje) 

,  Amin  , 

/'min  „  ^min 

where  dmax  is  the  largest  degree  of  the  nodes  of  the  graph  Q, 
which  is  finite  by  Assumption  2.  It  follows  that 


IKII 


which  shows  that  sf  is  bounded. 


For  an  infinite  network  ( Q ,  II  ),  we  introduce  the  incidence  op¬ 
erator  szf  :  Ur  — >  Sp,  which  is  defined  by  the  transformation: 

(-efj)u  =  £  au,eje,  j  £  Ur,  (16) 


Now  we  are  ready  to  prove  the  Generalized  Current  Theo¬ 
rem  2. 
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Proof  of  Theorem  2.  We  first  prove  that  among  the  flows  in 
Ur.  that  are  limits  of  finite  support  flows,  the  flow  with  the 


minimum  dissipated  energy  exists  and  is  unique,  and  that  this 
flow  is  a  current.  Then  we  show  that  there  can  be  only  one 
such  current. 

For  a  flow  of  intensity  j  that  is  injected  at  u  and  extracted  at  v, 
the  corresponding  divergence  to  is  given  by  tou  =  j,  tov  =  —  j 
and  u)p  =  0  for  all  p  £  {u,  u}.  Pick  a  path  V  from  u  to 

v,  and  construct  a  flow  jpath  of  intensity  j  from  u  to  v  along 
V  as  follows: 

fj  e£V,e  =  V 

Jfpath  =  <1  -J  e£V,e^P 

[o  e  iV 

It  is  easy  to  see  that  j  is  a  finite  support  edge-function  in 
Hr  that  satisfies  the  constraint  equation  sij  =  to.  All  flows 
satisfying  this  constraint  lie  in  the  linear  variety  jpath+J\T(si), 
where  J\f(si)  is  the  null  space  of  si .  Since  si  is  a  bounded 
linear  operator,  its  null  space  is  closed.  As  a  result,  AT  {si), 
which  is  the  space  of  all  circulations,  is  a  Hilbert  space. 
Consider  the  subspace  of  J\f{si)  that  consists  of  all  finite 
support  circulations,  and  denote  it  by  Afp{si)  (“F”  for  finite 
support).  Its  closure  J\fp(si)  is  a  closed  subspace  of  the 
Hilbert  space  J\f{si).  By  the  Projection  Theorem  applied  to 
linear  varieties  (Theorem  1  in  section  3.10  of  [21]),  there  exists 
a  unique  edge-function  in  jpath  +  J\fF(.si)  of  minimum  norm, 
which  we  call  i,  and  which  is  orthogonal  to  A fF{si). 

Since  i  —  jpath  £  J\fp(si),  there  exists  a  sequence  of  finite 
support  circulations  c*-™-*  such  that  — >  (i  —  jpath),  where 

the  convergence  is  in  Hr  norm.  Define  Fn’  :=  jpath  +  An\ 
so  that  by  construction,  each  j1-'1'1'  is  a  finite  support  flow  of 
intensity  i  from  u  to  v,  and  j<-n>  — >  i  in  Hr.  This  establishes 
the  existence  and  uniqueness  of  the  flow  with  minimum  power 
dissipation  that  is  the  limit  of  a  sequence  of  finite  support 
flows. 

Since  i  is  orthogonal  to  Afp{si), 

(i,  c)  =  0  (20) 

for  every  every  c  £  J\fF{si).  Declare  the  generalized  potential 
drop  across  an  edge  e  as  Reie  to  satisfy  Ohm’s  law.  If  the 
graph  has  no  loops,  Kirchoff’s  loop  law  is  trivially  satisfied 
by  these  generalized  potential  drops.  If  the  graph  has  loops, 
pick  a  loop  C  and  define  a  scalar  edge-function  /  :  £  — ►  R  as 

!1  if  e  £  C  and  e  =  C, 

—  1  if  e  £  C  and  e  f  C  j 

0  if  e£C. 

Now  define  a  finite  support  circulation  c*  as  c*  =  fe  J,  where 
J  is  an  arbitrary  k  x  k  matrix.  We  have 

0  =  frO  =  £>&<£) 

eec 

=  Tr(C ReJ )  =  ^  .fe  Tl'(  JT Reie) 

e£C  e£C 

=  Tr  JT{J2feReie) 
e£C 


Since  this  is  true  for  arbitrary  J,  we  must  have 

YJ{fe{Reie)}=  0,  (21) 

e£C 

which  in  turn  must  be  true  for  every  loop  C,  since  the 
arguments  above  can  be  repeated  for  every  loop.  Eq.  (21) 
therefore  shows  that  the  net  potential  drop  along  every  loop  is 
0.  In  other  words,  the  generalized  potential  drops  determined 
by  i  in  accordance  with  Ohm’s  law  satisfies  Kirchoff’s  loop 
law.  Construction  of  a  generalized  node  potential  function  V 
is  now  trivial.  Therefore  i  is  a  generalized  current. 

To  prove  uniqueness  of  the  current,  let  i  and  i  be  two  currents 
from  u  to  v  with  intensity  i.  Define  an  edge-function  d  :  E  —* 
Rfcxfe  as  de  :=  ie—ie.  We  see  that  d  £  Afp(si).  From  linearity 
of  the  inner  product, 

(d,  d)  =  (i  —  i,  i  —  i)  =  (i,  d)  —  (i,  d)  =  0  —  0, 

where  the  last  equalities  follows  from  (20),  since  by  construc¬ 
tion,  both  i  and  i  are  currents.  Thus, 

^  Tr {d^ Red e)  =  0  =>■  de  =  0  Ve  € 

since  Re  >  0  for  all  edges  e£  ‘E.  We  therefore  conclude  that 
i  =  i,  which  proves  that  the  current  i  is  unique. 

To  examine  the  uniqueness  of  potentials,  suppose  that  V  and 
V  are  two  potentials  associated  with  the  same  current.  Because 
of  Ohm’s  Law,  we  conclude  that 

Vu  -  Vv  =  Vu  -  Vv  =>  Du  =  Dv,V(u,  v)  £  £, 

where  D  =  V— V.  Since  Q  is  connected,  D  must  be  a  constant, 
but  is  otherwise  arbitrary.  This  shows  that  the  node  potentials 
are  unique  up  to  an  additive  constant. 

If  i  is  a  current  with  intensity  i  and  i  is  a  current  with  intensity 
i,  both  from  u  to  v,  it  can  be  shown  in  a  straightforward 
manner  that  ai  +  (3i  is  also  a  current  with  intensity  ai  +  pi 
from  u  to  v,  from  which  the  linearity  from  i  to  i  follows.  A 
similar  linearity  proof  also  holds  for  the  potential  differences. 


The  corollary  presented  next  is  essentially  a  repetition 
of  (20),  but  is  restated  because  of  its  usefulness  in  several 
subsequent  proofs. 

Corollary  1:  A  flow  i  is  the  generalized  current  in  the 
network  (Q,  R)  if  and  only  if 

(*,  c)  =  0 

for  every  circulation  c  £  J\fp{si).  □ 

Proof  of  Lemma  1.  For  the  current  with  intensity  i  flowing 
from  u  to  v,  we  define  a  divergence  to  as 

top  =  0  Vp  €  ‘li  \  {it,  u},  t ou  =  i,  tov  =  —  i. 
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The  flow  constraint  now  becomes  Aj  =  to.  The  current  i  is 
the  flow  that  satisfies  this  constraint  and  minimizes  the  energy 


dissipation  ^eg£:  T r(jjReje),  as  shown  in  Theorem  2.  For 
every  node  p  £  if,  the  flow  constraint  becomes 

(VF/)p  =  UJp  ^  '  dp,eje  “  ^ p •  (22) 

ee£p 

Recognizing  that  this  is  a  k  x  k  matrix  equation,  we  express 
it  as  k  separate  vector  equations: 

^  '  &p,eje,l  ^p,li  (  1,  .  .  .  , 

eG'Ep 

where  the  second  subscript  l  represents  the  Ith  column  of  the 
corresponding  matrix.  It  is  easy  to  see  that,  for  every  /,  the 
constraints  on  the  1th  column  of  je’s  depend  only  on  the  1th 
column  of  up,  and  therefore  on  the  1th  column  of  i.  As  a 
result,  the  solution  to  this  optimization  problem  is  equivalent 
to  solving  k  separate  problems  “minimize  X^ee £j'eiReje,i 
subject  to  Aji  =  u}{\  for  l  =  1, . . . ,  k,  where  the  edge  function 
jl  and  the  node  function  w;  are  now  vector- valued:  ji  :  E  — > 
Rfc,  ui  :  V  — ■»  Rfc,  the  spaces  Hr  and  Sy  are  appropriately 
redefined,  and  the  incidence  operator  A  has  the  same  definition 
as  in  (16)  with  respect  to  the  new  spaces  HR,Sp.  Because 
of  column-wise  independence  of  the  current  on  the  intensities, 
the  matrix  current  on  every  edge  is  obtained  by  stacking  the 
k  vector-valued  currents  on  that  edge  as  columns.  For  every 
vector- valued  current  intensity  i i,l  =  l,...,k,  we  obtain  a 
corresponding  vector- valued  potential  difference  VU)i  —  14, ; ■ 
Again,  the  matrix-valued  potential  difference  Vv  —  Vv  resulting 
from  the  original  problem  consists  of  the  k  columns  that  are 
the  vector- valued  potential  difference  Vu  j  Vvj  resulting  from 
the  k  separate  optimization  problems  described  above. 

These  k  separate  optimization  problems  can  be  solved  to 
determine  the  vector-valued  edge  currents  in  the  same  manner 
that  the  single  optimization  problem  was  solved  in  the  proof 
of  Theorem  2  to  determine  the  matrix  valued  edge  currents. 
In  fact,  only  one  of  these  k  problems  needs  to  be  solved.  To 
understand  why,  we  first  note  that  the  linearity  between  the 
matrix  valued  quantities  i  and  Vu  —  Vv  that  was  established  in 
Theorem  2  will  be  retained  between  the  corresponding  vector¬ 
valued  quantities.  Specifically,  when  a  vector-valued  current  4 
flows  from  u  to  v  with  vector  intensity  i;,  the  vector- valued 
voltage  drop  Vu>i  —  14,;  will  be  a  linear  function  of  the  vector 
intensity  i/,  which  will  be  in  general  a  k  x  k  matrix.  Let 
i?®®  £  Rkxk  be  this  matrix.  Then, 

Vu<i  -  14,;  =  R%VU,  Vi;  £  Rk.  (23) 

From  linearity,  the  same  is  true  for  every  l  =  1 ,k. 
Stacking  together  the  k  columns  in  (23),  for  l  =  1, . . . ,  k,  we 
get  14  -  14  =  which  proves  that  the  linear  mapping 

between  matrix  intensity  i  and  matrix-valued  potential  drop 
Vu  -  Vv  is  the  k  x  k  matrix  ■ 

Proof  of  Lemma  2.  Pick  a  path  V  from  u  to  v,  and  construct 
a  flow  jpath  of  intensity  j  from  u  to  v  along  V  as  follows: 

fj  e&V,e  =  V 

jpath  _  J  j 

[o  e<fV 


The  assumed  properties  of  j  imply  that  j  £  jpath  +  J\fp(A). 
Let  j  VO  be  a  sequence  of  finite  support  flows  in  ( Q,R )  that 
converge  to  the  flow  j,  i.e.,  j(ra)  j  jrl  Hr.  Define 

c:=j-jpath 

c(n)  ._  j(n )  _  j  path . 

The  function  c  £  Hr  is  a  circulation  since  it  is  the  difference 
between  two  flows  of  the  same  intensity  between  the  same 
two  nodes.  Moreover,  is  a  sequence  of  finite-support 

circulations  that  converge  to  c  in  Hr.  Now,  since  is  a  finite 
support  circulation,  from  Corollary  1,  { i,c ("))  =  (4jpath  — 
jVO)  =  0  for  every  n,  and  therefore 

lim  (i,  jpath  —  j(ra))  =  0, 

n — >oo 

Using  linearity  and  continuity  of  the  inner  product,  we  there¬ 
fore  conclude  that 

lim  <*,/">)  =  (*,  jpath)  =►  (i,j)  =  (4  jpath) 

n— >oo 

=►  E  ntfReje)  =  E  Tr((i?e4)TJpath)  =  Tr((Uu  -  Vv)Tj) 

e€.E  e$LV 

(24) 

Since  i,j  £  Hr,  denoting  the  s*  column  of  ie  by  is,e  and 
the  i*  column  of  je  by  jt  e,  we  can  show  from  (24)  using 
straightforward  algebraic  manipulation  that 

OO 

qa,t  ■=  E  ,eRejt,e  <00.  Vs,  t  =  {1,  .  .  .  ,  k} , 

e=l 

and  that  the  series  converges  absolutely  for  every  s  and 
t.  Define  the  matrix  Q  by  [Q]s,t  =  qs,t-  Since  the  series 
converges,  for  every  e  >  0,  we  can  choose  N  large  enough 
such  that 

N 

) I'^Z^Reje  -  <2||  <  C, 

e=l 

where  ||  •  ||  represents  any  matrix  norm.  We  thus  conclude 
that  since  i,j  £  Hr,  the  series  ]Cee£  iJReje  converges 
absolutely  to  a  k  x  k  matrix.  Since  (24)  holds  for  an  arbitrary 
j,  it  can  be  shown  in  a  straightforward  manner  that  the  series 
Reje  must  converge  to  (Vu  —  I4)Tj.  Therefore  we 
get  the  desired  result 

E  C Reje  =  ( Vu  -  K)Tj.  ■ 

Proof  of  Theorem  4.  For  every  e  >  0,  we  can  find  a  finite- 
support  flow  j(n>  from  u  to  v  of  intensity  i  such  that 

IN-j(n)||<c,  (25) 

which  follows  from  the  characterization  of  the  current  i  in 
Theorem  2.  Pick  a  finite  subgraph  =  (‘F'M,  £(”))  of  Q 
from  the  nested  sequence  such  that  the  support  of  j  V0 

lies  in  (i.e.,  the  edges  on  which  j V‘)  is  not  zero  are  in 
■£W).  Note  that  by  construction  u,v  £  'L’(n 4  Denoting  by 
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i the  current  in  (Q^n\R),  it  follows  from  Corollary  1  that 
for  a  circulation  c ^  whose  support  lies  in 

(i(n),c(n)}  =  0,  and  (i,c(n))  =  0. 

=H  <*  -  J ("} .  c(n) )  |  =  |  <*,  c(n) )  -  (i(n) ,  c<") )  | 

=  |<*(”),c(”>)  —  (j(n),c(n))| 

=  !<*(") -jW.cW)  | . 

Pick  c(n)  =  —j(n\  which,  being  a  difference  of  two  finite 

support  flows  from  u  to  v  with  the  same  intensity,  is  a  finite 
support  circulation.  Furthermore,  its  support  lies  in  since 
both  i and  have  their  support  in  Q(n\  For  this  choice 
of  in  the  equation  above,  we  get 

=  II  i(")-j(")||2 

=>||*(n)-j(n)||2<||i-i{n)||||t(n)-j{n)||, 

from  the  Cauchy  Schwarz  inequality.  Therefore, 

||i(n)-j{n)ll<||»-j(n)||<e, 

from  (25).  From  the  triangle  inequality,  we  now  get 


which  implies  that 

=  'y  )  Jp,q(XP  ~  xq) 

(p,q)e‘E 

=  E  jp,qxp-  E  ip,qxi 

(p,9)€£  (p,9)e£ 

=  E  E  iLxp~Yl  E  iLx* 


peV  (p,<?)g£ 
p=p 


qeV  (p, <?)§£ 
q=q 


=  (E4  E  Jp.9)T-(E*9  E  ^)t- 

(27) 


peV  (p,9)§£ 
p=p 


ijeV  (p, <?)§■£ 

9=9 


If  j  is  a  flow  with  intensity  Ik  from  u  to  o,  using  (5)  we 
conclude  that  the  first  term  above  can  be  expressed  as 

(EE  E  7p,9)T  =  (Xu  -  Xo)T  +  (E  XP  E  79,p)T 

pg1^  (p,g)G£  peV  ( q,p )e,E 

p=p  p=p 

=  (xu-Xo)T  +  (^2xq  ip,  q)T- 

qeV  (p,<?)g£ 
q=q 


||i-i{T,)||<J|<-j{n)||  +  ||i(n)-j(n)ll<2C, 


which  proves  the  statement  that  i ^  — >  *  in  Hr. 

To  prove  the  convergence  of  the  effective  resistances,  pick  an 
arbitrary  i  £  M.kxk  and  let  i  and  j*”)  be  the  currents  with 
intensity  i  from  u  to  v  in  {G,R)  and  (Q^n\R),  respectively. 
Lemma  2  implies 


E  ^ Reie  =  {TReu,vh 


eGE 


Y  t)TMn)=  E  iin)TRei^  =  iTR^n\ 

eGE  eG£<n) 

=  iTKSvh 


eGE 


Combining  this  with  (27),  we  get  E[rr„]  =  ( xu  —  xQ)  =  xu, 
because  x0  =  0,  which  proves  sufficiency. 

If  j  is  not  a  flow,  there  is  at  least  one  node,  say  rg  V,  where 
the  flow  condition  (5)  is  violated.  Assume  for  the  moment  that 
r  is  neither  u  nor  o.  We  rewrite  (26)  as 

E[t£u]  =  y  (  jp,q(xp  —  Xq)  +  y  '  jp,q(xp  ~  Xq )  "F  R 

(P,9)£E  (p,9)e£ 

p—r  q=r 

where  T  denotes  the  remaining  terms  of  the  sum  and  does 
not  involve  xr, 

—  (  El  ip, 9  -  El  ip, 9)  2V+72, 

(P,9)6E  (p,9)e£ 

p=r  q=r 


where  the  last  equality  uses  the  fact  that  jFO  is  a  flow  in  (? 
with  intensity  i  (though  not  a  current).  Therefore, 


eGE 


where  the  terms  constituting  T2  also  do  not  involve  xr .  Since 
the  flow  condition  (5)  is  not  satisfied  at  r,  the  coefficient  of 
xr  above  is  not  zero  and  so  xu  is  biased.  The  same  proof 
technique  can  be  applied  to  the  case  when  r  is  either  u  or  o, 
which  proves  necessity. 


Since  i  —>  vn>  in  Hr,  the  left  hand  side  goes  to  0  as  n  — >  00. 
Since  this  is  true  for  arbitrary  i,  — >  R^v.  ■ 

Next  we  prove  Lemma  3  that  shows  that  in  a  finite  graph 
an  unbiased  estimator  must  be  a  flow. 

Proof  of  Lemma  3.  By  definition,  a  linear  estimate  of  the  node 
variable  xu  in  the  finite  network  ( Q ,  P)  is  given  by 

xu  =  E  ie  Ce 

eGE 

for  some  matrices  {je,e  £  £}.  Therefore, 

xu  =  E  ip,q  (Xp  ~  x<i  +  eP>®)  (26) 

(p,9)6£ 


If  j  is  an  unbiased  estimators  of  xu  in  the  finite  network 
(■ G ,  P),  the  covariance  of  the  estimation  error  is 

|£|  m 

E[(xu  -xu)(xu  -xu)T]  =  E [(EEe0(EE^)T] 

1=1  e=i 

xu,o  =  EE  n^T\ii  =  EEa?*, 

1= 1  /= 1 

where  the  second  inequality  was  obtained  by  using  the  fact  that 
the  measurement  errors  on  different  edges  are  uncorrelated. 
This  proves  the  second  statement  of  the  lemma.  ■ 

Next  we  provide  the  proof  of  Lemma  4  that  states  that 
unbiased  estimators  of  node  variables  in  a  measurement  graph 
exist  if  and  only  if  the  graph  is  weakly  connected. 
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Proof  of  Lemma  4.  If  Q  is  weakly  connected,  we  can  con¬ 
struct  an  undirected  path  V  from  a  to  o  and  define  an  edge- 
function  j  as  follows: 

fj  eeV,e  =  V 

^•path  _  J  j  e£V^^15 

[o  e  i  V 

where  e  =  V  means  that  the  orientation  of  the  edge  e  is  the 
same  as  the  orientation  of  the  path  V,  and  e  ^  V  means  the 
orientations  are  opposite.  The  orientation  of  an  edge  e  in  a  path 
V  =  ...  ,p,e,q, .. .  is  said  to  be  the  same  as  the  orientation 
of  the  path  if  e  =  ( p,q ).  If  e  =  ( q,p ),  the  orientation  of  the 
edge  is  opposite  to  that  of  the  path.  It  is  straightforward  to  see 
that  j  is  a  flow  of  intensity  Ik  from  u  to  o,  and  therefore  by 
Lemma  3,  j  is  an  unbiased  estimator  of  xu. 

If  Q  is  not  weakly  connected,  it  can  be  decomposed  into  a 
number  of  disjoint  subgraphs  such  that  every  one  of  them  is 
weakly  connected.  These  subgraphs  are  called  weakly  con¬ 
nected  components  of  Q.  Pick  such  a  weakly  connected  com¬ 
ponent  that  does  not  contain  the  node  o,  call  it  Gi  =  ('Ll,  £1), 
and  pick  an  arbitrary  node  u  in  G\ .  By  contradiction,  assume 
that  there  exists  a  flow  of  matrix  intensity  Ik  from  u  to  o.  Let 
Ai  be  the  generalized  incidence  matrix  of  Gi-  Let  G\  consist 
of  N  nodes  and  M  edges,  and  without  loss  of  generality,  let 
u  be  numbered  as  node  1.  Define  J  :=  \jf ,  jj, . . . ,  Jm]T  G 
l“x*  as  the  tall  matrix  of  the  flows  on  the  edges  in  the 
component  Gi  and  w  =  [4,0, . . .  ,0]T  G  4feiv><fe  wjtjj  /fc  jn 
the  1st  k  x  k  block  position,  and  0  everywhere  else.  Then  the 
conservation  law  (5)  can  now  be  expressed  compactly  as 

AiJ  =  u.  (28) 

Now  define  1  :=  [4,4---,4]T  G  RkNxk,  and  multiply 
both  sides  of  the  equation  above  by  1T,  which  is  equivalent 
to  adding  all  the  rows.  The  incidence  matrix  of  a  weakly 
connected  graph  has  the  property  that  the  sum  of  its  rows 
is  0  [15],  and  the  same  is  true  for  the  generalized  incidence 
matrix.  Since  G\  is  weakly  connected,  we  obtain  the  following 
contradiction 

lTiJ  =  lTu  =>  0  =  4.  (29) 

Thus  no  flow  of  intensity  4  from  u  to  o  is  possible.  The  result 
then  follows  from  Lemma  3.  ■ 

Proof  of  Lemma  6.  Let  is  :  £  — >  R  be  the  scalar  current  in 
(G,  1)  of  unit  scalar  intensity  from  u  to  v.  It  follows  from  (8) 
that 

<,  =  E(*e)2- 

eG!E 

We  first  claim  that  the  matrix  current  i  in  (G,R0)  of  intensity 
4  from  u  to  v  is  given  by  «s4- 

To  prove  this  claim,  let  c  G  A I'f(A).  Since  i  G  Hr  trivially, 

(i,  c)  =  E  Tr(C RoCe)  =  E  T r(i?0ce) 

eG £  eG £ 

=  E*eTr(ce)  =  E*eE4M) 

e££  e(=£  l—l 


where  ce  :=  R0ce  G  Rfcxfc  for  every  eG  £,  and  G  I 

represents  the  ((,m)th  scalar  entry  of  the  matrix  ce.  Hence, 

k  k  k 


&  c>  =  E  E  *e4M)  =  E  E  *e4M)  =  E<iS 


M) 


eG  £  Z=1 


1=1 eG£ 


Z=1 


(30) 


where  the  k  inner  products  on  the  right  hand  side  are  evaluated 
in  the  space  Hi  defined  for  the  scalar  network  (Q ,  1).  Since  c 
is  a  circulation,  Ac  =  0.  Therefore 

^  ^  u,p?ece  R0  ^  ^  dp^ece  —  0,  Wp  G  4* , 

eGZEp  eGEp 

where  ‘Lp  is  the  set  of  edges  in  Q  that  are  incident  on  p,  which 
shows  that  c  is  also  a  circulation.  Clearly,  each  scalar  valued 
edge  function  (f  l-rn'>  :  £  — >  K  is  also  a  circulation  for  the 
scalar  electrical  network  (Q,  1).  It  follows  that  ( is ,  c^’O)  =  0 
for  each  /  =  1, . . . ,  k.  Hence,  (30)  implies 


(i,  c)  =  0 


for  every  c  G  J\f(A),  which  is  precisely  the  characterization  of 
the  current  in  Hr  stated  in  Corollary  1 .  This  proves  our  claim 
that  i®4  is  the  current  in  ( 0,Ro )•  Therefore,  the  effective 
resistance  is  given  by 

KSv  =  E  iTeRoH  =  Ro  E(*e)2  =  Rorf,v , 

eG  E  eG!E 

because  of  (8),  which  completes  the  proof.  ■ 
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